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INTRODUCTION 


The performance of line-scan imaging systems, such as TV cameras and 
optical-mechanical scanners, has received appreciable attention in the litera- 
ture (refs. 1 to 14). The emphasis of these investigations usually has been 
on resolution, detection, recognition, identification, and accuracy of recon- 
struction of spatial detail. The most useful and widely accepted analysis 
approach that evolved from these investigations (most notably through the 
efforts of Schade, refs. 4 and 5) is to apply Fourier methods to the evalua- 
tion of optical imaging processes. The importance of this approach is that 
the MTF and noise characteristics of optical and electronic components can be 
measured with practical instrumentation and conveniently combined with each 
other to predict and evaluate the performance of electro-optical systems. 

In this paper we explore information theory as a logical extension of 
Fourier methods to assess the performance of line-scan imaging systems, with 
emphasis on systems which use a digital communication link for transmitting 
data. Information theory is used to derive a single figure of merit that 
accounts for the statistical properties of the radiance field, the spatial 
response (PSF or MTF) and noise characteristics of the imaging system, and the 
effects of sampling and quantization due to the line-scan and digitization 
process. It treats the image that is reconstructed from the digital data as 
a received message which gives information about the incident radiance and 
accounts for degradations as loss of information. 

Fellgett and Linfoot (refs. 15 and 16) first applied Shannon’s (ref. 17) 
theory of information to the assessment of image quality. They formulated the 
information capacity and density of photographic images and accounted for the 
degradation of image quality caused by blurring and random noise. These formu- 
lations have been applied to the evaluation of photographic film by Linfoot 
(ref. 18), Jones (ref. 19), and Shaw (ref. 20), and of radiation detectors by 
Jones (ref. 21). Buck and Park (ref. 22) and Halyo and Stallman (ref. 23) 
extended the formulations to include performance characteristics of line-scan 
imaging systems by accounting for degradations caused by aliasing and quanti- 
zation. Aliasing errors are generated when spatial details of the radiance 
field are insufficiently sampled, and quantization noise is generated when the 
discrete (i.e., sampled analog) signal is digitized. 

These formulations based on information theory are constrained by the 
assumption that the signal and noise amplitudes are Gaussian, ergodic, additive, 
and statistically independent. Nevertheless, it is of interest to explore 
information as a figure of merit for assessing the performance of line-scan 
imaging systems and, in particular, for optimizing their efficiency to acquire 
and transmit information. This interest arises because the quantity of data 
that is transmitted and the amount of information that the data can contain are 
inevitably related by sampling and quantization. The relationship between 



information and data suggests the concept of information efficiency (i.e., ratio 
of information density to data density) as a useful design criterion. 


DEFINITIONS, ASSUMPTIONS, AND FORMULATIONS 

Figure 1 illustrates a linear, space -invariant imaging process that con- 
verts the continuous radiance field L(x,y) into a digital signal s (x,y;X,Y;<) . 



Figure ^ .- Model of line-scan imaging process. 


In the first of the following four subsections, we formulate the conversion of 
the radiance field into a discrete signal s(x,y;X,Y). In the second section 
we define properties of the digital signal s (x,y ;X, Y;ic) that is generated when 
the discrete signal s(x,y;X,Y) is quantized. In the third section we formu- 
late the information and data density of the digital signal, and in the fourth 
section we define and discuss information efficiency. 

The information density of an image that is reconstructed from discrete 
data is a function of the image reconstruction process as well as of the imaging 
system. We account for image reconstruction by a low-pass filter that coincides 
with the sampling passband. This reconstruction filter would be optimum - in 
the sense of transferring information from the output of the imaging system to 
the image display without loss of information - if the signal were band-limited. 
We do not investigate optimum reconstruction for signals that are not band- 
limited. 


Imaging Process 

The conversion of a continuous radiance field L(x,y) into a discrete 
signal s{x,y;X,Y) can be defined by the expression 


s(x,y;X,Y) = {k L(x,y) * T(x,y) + N(y) * [6(x) 


Yj 
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The function T(x,y) is the PSF (point-spread function or spatial response) 
of the imaging system given by 
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T(x,y) = T£,(x,y) * Tp(x,y) * [6(x) Te(y)] 


where T£(x,y), Tp(x,y), and 6 (x) T^(y) are the PSP's of the lens# of the 
spot intensity profile (for TV cameras) or photosensor aperture shape (for 
optical-mechanical scanners), and of the electronic filter, respectively. The 
steady-state gain of the conversion of radiance into the photosensor signal 
(see the Appendix) is denoted by K, the electronic noise by N(y), convolution 
by *, and the sampling function (ref. 24) by 
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Rectangular (Cartesian) coordinates (x,y) in the object plane are used as 
reference for the imaging coordinates. The sampled signal s(x,y;X,Y) is an 
infinite array of 6 functions on a rectangular lattice with spacing X and Y 
in the x- and y-directions, respectively. 

Salient properties of the process defined by equation (1 ) are often more 
convenient to evaluate in the frequency domain rather than in the spatial domain. 
We denote the functions g(U^co) and g(x,y) as the Fourier transform pairs 
given by 


g(^,to) 



g(x,y)e-i2it(v)x-Kx)y) 


g(x,y) 



g(U,w)ei2TT(xU+yto) dw 


The Fourier transform of equation (1 ) yields 
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(2a) 


S(U,( 0 ;X,Y) = [K £(U, 0 )) T(U,W) + N(W) Te(W)] * XY JJ_[(x\J,Ya)) 


/V 

where T(U,U)) is the MTF (modulation-transfer function or spatial frequency 
response) given by 


T(U,(0) = Ti,(U,C0) Tp(U,(0) Te(W) 


and (from ref. 24) 
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Equation (2a) can be equivalently written as 

s(u,0);X,Y) = s(u,w) + Sa(u,w;X,Y) (2b) 

where s(U, 0 )) is the signal component prior to sampling as given by 

s(u,u) = K L(U,w) T(u,w) + N(w) Te( 0 )) (3) 

and Sa(U,w;X,Y) represents the sideband components of s(U,o);X,Y) that 
are generated by sampling as given by 


Sa(u,w;X,Y) 


OO OO 



(m,n)?^(0,0) 



(4) 
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We use the inverse Fourier transform of the frequency passband of the 
sampling lattice with spacing (X,Y) , or briefly the sampling passband, as the 
reconstruction function. The sampling passband is given by the rectangle 
function (ref. 24) 


II(XU,»o) = 



(elsewhere) 


The corresponding reconstruction r(x,y) is the inverse Fourier transform of 
r(U, 0 J) = s(U,W;X,Y) n(XU,YW) 
as given by 



where s(mX,nY) is the value of s(x,y;X,Y) given by equation (1 ) . 


Signal Characteristics 

We assume that the radiance L(x,y) and the noise N(y) are independent 
Gaussian random (stochastic) processes and designate their Wiener spectra as 
$l(\j,u) and $)}((0), respectively. We treat quantization noise as if it 
were additive "white" Gaussian noise with a Wiener spectrum $q(<). The 
Wiener spectrum digital signal s (U,tO;X,Y;K) can 

then be expressed as 


$s(U,co;X,Y;k) = + $n(W;Y) + (5) 

The term $g(v),(u), which represents the signal component centered at the 
location (U,w) = (0,0), is given by 

$s(U,U) = 1t(U, 03)|2 (g) 
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This term accounts for image degradation due to blurring caused by loss of small 
detail when the higher spatial frequency components of the radiance field are 
attenuated by the MTF of the imaging system. 

/\ 

The term $g(U, 0 );X,Y) , which represents the signal sideband components 

/m n\ 

generated fcjy sampling and centered at the locations (U,oj) = , with 

lyx y ) 

(m,n) ^ (0,0), is given by 


$a(U,C0;X,Y) 
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(7) 


This term accounts for image degradation due to aliasing caused by masking of 
spatial detail when displaced spatial frequency components from the sampling 
sidebands intrude into the image reconstruction passband. 

✓V 

The term $j^(w;Y), which represents the sampled electronic noise at the 
filter output, is given by 


OO 
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It should be noted that just as undersampling of the signal frequency spectrum 
generates aliasing, under sampling of the noise frequency spectrum generates 
additional noise. 

To model the effective noise generated by the quantization process, we 
assume that (1) the discrete signal s(x,y;X,Y) is linearly quantized into K 
levels over the effective range 2cOq, so that the quantum levels have a uniform 
spacing of 2oJq/k, where 


Qg2 = k2 


OO 

_oo 


du du) = 
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is the maximum variance of the signal s(\^rW) among all T{\),U}) such that 
|t(U/ 0))| S 1/ and c is a constant to be determined later; (2) the quan- 
tization error of any one sample is uncorrelated with that of any other sample; 
and (3) the signal is equally likely to occur anywhere in the quantization 
interval -cOg/K to cog/ic. These assumptions imply that the quantization 
error has the uniform probability density function (refs. 25 to 27) 




P(n^) = < 


2cOc 



(elsewhere) 


In fact/ a random variable that is constrained to a finite interval has a 
maximum entropy when its probability density function is uniform. A signal 
with the uniform probability density function pCn^^) has a mean equal to zero 
and a variance given by 


cag/ic 





P(n^) 


dn^ 
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Since quantization noise is uncorrelated (in the spatial domain) ^ it has a 
Wiener spectrum equal to its variance; that is. 


$q(Ura3;fc) = <^q(K) 



(9) 


Information and Data Density 

Let A denote a rectangular ( isoplanatism) patch centered at x = y = 0. 
For M line scans and N samples per scan in A, x and y are limited to 


-XM XM 

< X < — 

2 2 



y < 


YN 

T 


and the area of A is |a| == XYMN. Any function g(x,y) is then said to be 
confined to A if g(x,y) = 0 for all points outside A. Furthermore, let 
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the spatial function g(x,y) be a second-order, stationary, Gaussian random 
process that is effectively band-limited to the sampling passband H(XU,yw).^ 
Following Shannon (ref. 17), we can define the statistical uncertainty of this 
process, or the quantity of information contained in the area A (ref. 15), to 
be (refs. 22 and 23) 


1 /2X 1 /2Y 


-iN I i log2 [4ir $g(U,w)] dU dtu 


-1/2X -1/2Y 


The units of Hg are binits. 

The information gained about patch A of a scene can be regarded as a 
reduction in the uncertainty of the probable state of that patch. In this sense, 
it can be shown that the amount of information that is gained is (refs. 22 

and 23) 

1 /2X 1 /2Y 

.-lu, 5 J log2 [4 tt $g ( v),U;X,Y;K) ] dU du 

-1/2X -1/2Y 

1/2X 1/2Y 

■ j j {4TT[Sa(U,W;X,Y) 

-1/2X -1/2Y 


+ $j^(tO;Y) + $q(<)]} dU dU) 


where 4*s is the Wiener spectrum of the digital signal as given 
by equation (5) . This formulation is permitted because the additive terms in 
equation (5) are statistically independent. The information density, or 
entropy, of the digital signal can thus be formulated as (refs. 22 and 23) 


^No attempt is made to investigate the optimization of reconstruction 
filters. 
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-1/2X -1/2Y 


+ $n(u;Y) + <I>q(tc) 


^ ^ /N /N 

where $s(u,oj), $a(U,03;X,Y) , ^q(>^) are given by equa- 

tions (6) to (9). The units of hj[ are binits per square meter. 

Each discrete signal s(X/y;X/Y) is quantized into K levels. ThuS/ the 
number of distinguishable states in patch A is and the amount of data 

in A is 

|A| 

= MN 1092 < = lo92 < 


The units of are bits. 


The data density for r|-bit encoding r 


K = 2^, is 
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The units of h^^ are bits per square meter. 


Information Efficiency 

We define the ratio h^/h^ as the information efficiency of the digital 
image data. This definition of information efficiency is analogous to 
Khinchin’s definition of "relative entropy" as the ratio h/log m, where h 
is the entropy of a test and log m is the maximum value of h for the m 
different symbols of the test (ref. 28). Another analogy is Jones* definition 
of "information efficiency" of a beam of light as the information capacity per 
transmitted photon (ref. 29) . 

However, to properly interpret the information efficiency hj/h^, we must 
account for an important difference between continuous and discrete entropies 
(ref. 17). The data density h^ is defined for a discrete random variable 
(i.e., quantization levels with a uniform probability density function) for 
which the entropy provides an absolute measure of randomness. The information 
density h^ is defined for a continuous random variable (i.e., an analog signal 
with a Gaussian probability density function) for which the entropy provides 
a measure of randomness relative to an assumed standard (namely, the coordinate 
system chosen with each small spatial element dx dy given equal weight) . It 
would be intuitively satisfying to adjust the ratio h^/h^ so that the theo- 
retical upper limit of information efficiency becomes unity. This upper limit 
is reached for the following three conditions: 
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is constant within 


1. The Wiener spectrum of the radiance field L(x,y) 
the sampling passband; that is. 







(elsewhere) 


This condition represents inaximuin entropy within the sampling passband. 

2. The imaging system has the (unrealizable) MTF 


T(U,OJ) 





(elsewhere) 


This condition prevents aliasing and blurring within the sampling passband. 
For these two conditions, equation (10) reduces to the expression 


1 

2XY 


log2 



( 12 ) 


where is the maximum possible variance of the signal and and 

Oq2 are the variances of the electronic and quantization noise, respectively. 

3. The quantization intervals are very large compared with the magnitude 
of the electronic noise fluctuations (i.e., o„ » o^) . Substituting equa- 
tion (9) for Oq2 further reduces equation (12) to 


hi 


1 

2XY 


1092 


+ 
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2XY 


log2 
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XY 


log2 



c 


( 13 ) 
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It follows by comparison of equation (13) for hj with equation (11) for 
the data density that the information efficiency h^/h^ is unity if 

c = n/T. This adjustment of the upper limit of the information efficiency h^/h^j 
to unity leads to a linear encoding of the Gaussian signal variation over a 
dynamic range of - \l30g to \f30g^ which encompasses 92 percent of the signal. 

Ifr instead of the third condition, we assume that the quantization inter- 
val is very small compared with the magnitude of the electronic noise fluctua- 
tions (i.e., CJq « 0j^) or that the analog signal is not quantized (i.e., 

CTq = 0), the expression for h^ given by equation (12) reduces to 

0 4 , 


This expression may be recognized as Shannon's channel capacity with an average 
power limitation (ref. 17). 

A basic assumption in formulations of the entropy of signals transmitted 
through a communication channel is that the frequency of these signals can be 
sufficiently band-limited. The limiting rate of information transmission (i.e., 
channel capacity) is reached for this condition when the signals approximate, 
in statistical properties, white noise (Shannon’s theorem 17). However, a 
space-varying radiance field generally cannot be sufficiently band-limited by 
the response of optical systems prior to line-scan sampling, so that aliasing 
caused by insufficient sampling must be accounted for. Herein lies a basic 
difference between formulations of information acquired by line-scan imaging 
systems and formulations of information transmitted through communication 
channels (ref. 17) or acquired by photographic film (refs. 15, 16, and 18 
to 20) and radiation detectors (ref. 21). 


RADIANCE AND SYSTEM MODELS 
Radiance Field 

We assume that the radiance field L(x,y) is both homogeneous and iso- 
tropic, so that the variance of L(x,y) is independent of (x,y) and the 
autocovariance (and autocorrelation) are functions only of the relative 
distance (ref. 30) 

r = [ (xi - X 2 >^ + (yi - 


between points (x-j ,y*| ) and (X2ry2)* Furthermore, we assume that the auto- 
covariance of L(x,y) is 
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^LK(r) = <?L^e 


-r/Ur 


0 5) 


so that the associated Wiener spectrum, which is the circularly symmetric Fourier 
transform (i.e., the Hankel transform) of ^i,(r), is 

= ^l(^) = 0 6) 

tl + (2TrUpP)2] 3/2 


where + w2 (ggg fig. 2). 






(b) ExampU:Mr/y*l/3. 





(c) Example: pr/Y”l> 


Figure 2.- Wiener spectrum of radiance field. 
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Equation (16) can be derived by assuming that L(x,y) is a random set of 
two-dimensional pulses whose width r obeys the Poisson probability density 
function with the (expected) mean width and whose magnitude obeys the 

Gaussian probability density function with the (expected) mean Ul and variance 
(refs. 31 and 32). The variance and the Wiener spectrum $l(u»w) 

are related by 


Oi} = $ 1 ,( 0 ) 





dv) du) 


J 


= 27T \ p $l(P) dp 


0 7) 


that is, is the value of the integrated Wiener spectrum* 


Imaging System 

The conversion of radiance into a discrete signal involves some sort of 
photon detection and sampling mechanism. The most common mechanisms are 
TV cameras and optical-mechanical scanners. In this paper we disregard the MTF 
of the objective lens, so that the MTF t(u,u 3) of the imaging system (see 
fig. 1 ) reduces to 


T(U,W) = Tp(u,w) Te(w) 


/s 

where Tp(u, 0 )) is the MTF of the spot intensity of TV^ cameras or of the 
photosensor aperture of optical-mechanical scanners; is the MTF of 

the electronic filter; and (i) is the spatial frequency component in the line- 
scan direction. The sampling interval X represents the distance between 
successive line scans, and the interval Y represents the product of the line- 
scan rate and the time between electronic samples. (There is, of course, no 
electronic sampling in commercial TV; the signal that is generated along the 
line-scan direction is transmitted as an analog signal.) 

Figure 3 illustrates salient characteristics of one spot intensity pro- 
file and two photosensor aperture shapes. The profile and apertures are of 
equivalent size; that is. 



Tp(x,y) 


*-oo 


dx dy = Tp(0,0) 
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It follows that T 


p(0,0) 

r A 


Tp(x,y) 




TTY- 


= 4/fty^ for the Gaussian spot intensity, and 


((x,y) € aperture area) 


(elsewhere) 


for the circular and diamond photosensor apertures. It is convenient to regard 
the diameter Y of the circular aperture also as the equivalent diameter of 
the Gaussian spot intensity and diamond aperture, that is, as the equivalent 
diameter of the PSF of the photon-detection mechanism. The MTF's tp(t^r^) 
are given by the following expressions: 

(a) Gaussian: 


Tr>(V),a)) = Tn(t)) = e“(^YP/2)^ 


( 18 ) 


(b) Circular; 




Jl (TTYP) 
TTYP/2 


09) 


(c) Diamond : 


^ 7 /ttyu \ 7 /ttyu ^ 

t„(\J,ca)) = sine - + Y^ 1 sine -1 - Y^ , 

P 2\ 2 / 2\ 2 j 


( 20 ) 


Mertz and Gray (ref. 7) were the first to observe that reasonable spot 
intensity profiles and photosensor aperture shapes of equivalent size result 
in about equal blurring but that some profiles and shapes suppress aliasing 
better than others. Schade (refs, 4 and 5), in particular, has shown that the 
Gaussian intensity profile illustrated in figure 3(a) is advantageous for sup- 
pressing aliasing, providing that sufficient overlap exists between successive 
line scans. 

The shape of the photosensor aperture in optical-mechanical scanners is 
commonly circular, as illustrated in figure 3(b), or rectangular. To obtain 
a response Tp(x,y) that is similar to the Gaussian profile would require 
shading of the aperture with a variable transmittance profile. However, this 
would be extremely difficult, since these apertures are typically less than a 
millimeter across. Instead, as shown by Katzberg et al, (ref, 9), it is pos- 
sible to accomplish a similar effect by shaping the aperture, that is, by 
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adjusting the width of the aperture to follow some curve which then adjusts the 
U spatial frequency response normal to the line-scan direction. The exact 
aperture shape along the line-scan direction is less important, since the effec- 
tive 60 spatial frequency response can be reshaped by an electronic low-pass 
filter. To demonstrate the improvement that can be attained with photosensor 
aperture shaping, we choose the diamond shape illustrated in figure 3(c). This 
diamond shape has already been shown (refs. 1, 9, 14, and 23) to be superior 
(in suppressing aliasing) to the circular shape. 

For the electronic frequency response we select the function given by 


r 

1 - (2Yw)4 

Te(t^) =\ 


(|o)| < V2Y) 


(21 ) 


1^0 doil > 1/2Y) 


and plotted in figure 3(d). The cutoff frequency 1/2Y ensures sufficient 
sampling (i.e., a Nyquist sampling rate) of the analog signal (and noise) 
generated along the line-scan direction. 


RESULTS AND CONCLUSIONS 
Computational Results 

Computational results shown in figures 4 and 5 account only for the blur- 
ring and aliasing caused by the PSF and sampling process of line-scan photon- 
detection mechanisms, whereas results shown in figures 6 and 7 account, in 
addition, for the degradations caused by electronic noise and quantization. 

By accounting first only for blurring and aliasing, we establish upper limits 
for the information density that can be attained with the photon-detection 
mechanisms evaluated in this investigation. The inclusion of electronic noise 
and quantization leads to the assessment of practical systems. 

Results are presented as a function of normalized^parameters to account 
for a wide range of conditions. The Wiener spectrum $^( 0 , 0 )) of the radiance 
field given by equation (16) is normalized as 


$L(^rW) = Ol"2 $l(U,03) 


where is the variance of the radiance field given by equation (17). The 

mean spatial width u^. of the radiance field and the sampling intervals X 
and Y of the imaging system are normalized by the equivalent diameter y of 
the PSF's. For example/ for the circular aperture with Y its actual diameter/ 
X/Y = Y/Y = 1 represents contiguous coverage/ and Uj-/Y = 1 represents mean 
spatial detail equal to the diameter of the projection of the aperture/ or its 
IFOV/ onto the scene. 
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(a) GoMttion spot inl«n«itv. (b) Circular plwfoMtnfor opartwr*. (c) Diamond photosonior oportur*. 

Figure 4.- Variation of blurring aliasing Og, information density hi, 

sampling density hg, and information per sample hi/hg vs sampling 
intervals X = Y for several mean spatial widths of the radiance 

field, hi and hi/hg include curves for a ("white") Wiener spectrum 
that remains constant with frequency. 



without electronic filter 
with electronic filter 



X/y = Y/y 

Figure 5.- Variation of blurring Oj,, aliasing Og, and information per 
sample hi/h^ vs sampling intervals X = Y for a circular photosensor 
aperture with and without electronic filter. 
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(d) Gaussian spot inlansity*' ® s^® ^*7. (a)Oiamond photosansor apartwra; O ^7 0^oK*128, H *7. (f)Grtulas pholosansar oportura :®s/*^n*'*®12®. *1*7- 


Figure 6.- Variation of information density hj, data density h^, and 

information efficiency hf/h^j vs sampling intervals X = Y for several 
meem spatial widths Pr of the radiance field. 
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Figure 7.- Variation of information density data density and 

information efficiency hi/h^j vs sampling intervals X = Y for 
several encoding levels f). Mean width Pj- of the radiance field is 
equal to the equivalent diameter Y of the PSP. 



Image degradation due to blurring is characterized by the (normalized) 
variance gg computed by (ref. 23) 


o 


1 /2Y 1 /2X 

-1/2Y -1/2X 


- T (U A') I 2 dU dw 


(22) 


Blurring occurs when the higher frequency components of the radiance field are 
attenuated by the MTF T(u,w) of^the imaging system within the sampling pass- 
band; for example/ = o if T (U,w) = II(XU,Yto). Fellgett and Linfoot 

(ref. 15) refer to the degradation defined by equation (22) as fidelity defect 
due to loss of sharpness. Figures 4 and 5 present curves of the standard 
deviation which show how blurring increases with decreasing sampling inter- 

vals. This increase in blurring occurs because the (fixed) MTF t(U,(jo) of 
the imaging system becomes an increasing source of degradation of the signal 
frequency components that could otherwise be reconstructed as the sampling pass- 
band II(XU/Y()J) increases. This effect is particularly pronounced for small 
spatial detail (i.e./ U^/y < 1/3). 


Image degradation due to aliasing is characterized by the (normalized) 
variance 0^2 as computed by 


1/2Y 1/2X 
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(m,n)^(0,0) 


m 

-r 0 ) 

X 
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(23) 


Aliasing occurs because displaced spatial frequency components from the sampling 
sidebands intrude into the sampling passband; for example, 0^2 - q if 
T{u,oj) » II(XU,YW), Figures 4 and 5 present curves of the standard deviation 

which show how aliasing decreases with decreasing sampling intervals- This 
decrease in aliasing occurs because the Wiener spectrum [x(V),(jO)|2 

decreases with frequency and because the distance between sampling sidebands 


(as observed in the frequency domain) 


passband increases only as 




increases as 




whereas the sampling 


It should be noted that blurring is only weakly dependent on differences 
between the PSF of the spot intensity and photosensor apertures, whereas alias- 
ing is strongly dependent on these differences, as has already been observed 
in a number of previous investigations (refs. 1 , 4, 5, 9, 14, and 23). The 
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Gaussian profile and diamond shape are both superior (in suppressing aliasing) 
to the circular shape at broad sampling intervals (XA = YA ^ 0.5), and the 
Gaussian profile is appreciably superior to both aperture shapes at narrow 
sampling intervals (XA = YA ^ 0.5). These differences in performance are 
directly attributable to their MTF characteristics shown in figure 3. 

The information density h^, analogous to equation (1 0) but without 
electronic noise and quantization, is computed as 
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(24) 


The corresponding sampling density hg is 


1 



The units of hj^ are binits per y^, and of hg are samples per Fig- 

ure 4 presents curves of the information density hj^, sampling density hg, 
and the ratio h^/hg vs sampling intervals. The units of h^/hg are binits 
per sample. 

The curves in figure 4 were obtained for Wiener spectra that decrease with 
spatial frequency as formulated by equation (16); in addition, and h^/hg 

are also given for a ("white”) Wiener spectrum that remains constant with fre- 
quency. It can be observed that the curves of h^ and h^/hg for various 
mean spatial details approach each other as these details become larger until it 
becomes difficult to distinguish the curves from each other (at the scale of the 
drawing). This suggests that the curves for = 9 approach upper limits of 

hi and Ih^/hg for the assumed conditions. On the other extreme, as the mean 
spatial detail becomes smaller than the Wiener spectrum becomes 

increasingly Constant with frequency (within the MTF passband of the imaging 
system), and curves of h^ and h^/hg approach those for a white Wiener 
spectrum. 

The range of information per sample h^/hg is remarkably narrow for the 
wide range of Wiener spectra that has been considered. Since these curves do 
not include degradation due to electronic noise and quantization, they represent 
an upper limit of the information per sample that can be reached with line-scan 
photon-detection mechanisms for the assumed Wiener spectra and the PSF's. 
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Figure 5 shows results for the circular photosensor aperture with and 
without the electronic filter. The latter condition represents an optical- 
mechanical scanner design in which the IFOV is stepped at discrete intervals 
along the y-direction rather than scanned in a continuous motion; that is, 
the radiance field is spatially sampled in the y-direction as well as the 
x-direction. The effect of the electronic filter (for continuous line scans) 
is to increase blurring and decrease aliasing; the net effect is an improvement 
in information per sample of about 30 to 45 percent, depending on sampling 
intervals. This improvement represents an approximate upper limit that can be 
attained with electronic filters, since the assumed filter MTF ensures suffi- 
cient sampling along the y-axis. (Small changes in the response of this filter, 
by changing the exponent in eq. (21 ) from 4 to either 2 or 8, have little 
effect; a change to 2 increases blurring and decreases aliasing, and a change to 
8 has the opposite effect; the effect on information per sample is negligible.) 

Results shown in figures 6 and 7 account for image degradations due to 
electronic noise and quantization as well as blurring and aliasing. The infor- 
mation density hj is computed using the approximation of equation (10) given 
by 


1 /2X 1 /2Y 

hi='- J j* 1092 

-1/2X -1/2Y 




d\J dw 


(26) 


m=-oo n=-oD 


Me- 


r2 


(m,n)?^(0,0) 


The ratio is a convenient parameter for characterizing the electronic 
signal but is not the conventional rms SNR. Here, Og^ is^the maximum vari- 
ance of the signal s(vJ,o)) among all T(u,a') such that |t(u,o))| ^ 1, given 
by 

and 0^,2 is the variance of the electronic noise at the output of the elec- 
tronic filter, given by 


1/2Y 

°n^ = V |Te(w)|2dw 

-1 /2Y 


(Further details are given in the Appendix.) The corresponding data density 
is given by equation (11) as 
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= — 1092 ^ 
XY 


n 

XY 


where ri is the number of bits used to encode the K quantization levels. 

Both figures 6 and 7 present plots of the variation of information density 
h^, data density h^, and information efficiency h^/h^j with sampling inter- 
vals- Figure 6 characterizes performance as a function of mean spatial detail 
Mr of the radiance field for several ratios ^s/^n encoding levels r| 

that have been selected so that the rms magnitudes of electronic and quanti- 
zation noise are equal to each other. Figure 7 characterizes performance as 
a function of encoding levels r| for several ratios ^s/^n ^ fixed mean 

spatial detail equal to the equivalent diameter Y of the PSF's. 

Statistical properties of the radiance field, such as mean spatial detail 
or Wiener spectrum, are seldom known in practice. Therefore, it often becomes 
appropriate to regard each set of curves (for different values of u^/Y) in 
figure 6 as boundaries that encompass typical performance. 


Constraints and Conclusions 

Time versus spatial response .- When Shannon's theory of information trans- 
mitted through communication channels is applied to the formulation of infor- 
mation acquired with line-scan imaging systems, differences between time 
(electronic) and spatial (optical) MTF's must be taken into account. A time- 
varying signal can be sufficiently band-limited by practical electronic filters 
to reduce aliasing to an insignificant source of degradation. Formulations of 
information transmitted through communication channels have, partly for this 
reason, been based on the assumption of band-limited signals. However, formu- 
lations of information acquired with line-scan imaging systems cannot be 
simplified by this assumption. The realizability of MTF shapes of optical 
filters is constrained by the fact that their (sensitivity or transmittance) 
response can never be negative. This constraint leads to MTF's that tend to 
diminish very gradually with frequency, generally without a finite cutoff 
(except for lens diffraction) . These responses insufficiently band-limit the 
radiance field prior to line-scan sampling, a condition which tends to result 
in significant degradation due to aliasing. The inclusion of aliasing leads 
to significant departures in the performance characteristics of line-scan 
imaging systems from those of communication channels. 

Continuous versus discrete entropy .- Formulations of the information 
density of digital image data are subject to a somewhat arbitrary normal- 
ization of the (continuous) Gaussian signal variations relative to the (dis- 
crete) linear quantization intervals. We have adjusted the formulation of 
information density for computational purposes so that the theoretical upper 
limit of information efficiency reaches unity. This adjustment results in a 
linear dynamic range that encompasses 92 percent of the (assumed) Gaussian 
signal distribution. 
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Information density versus spatial detail *- The information density of 
discrete and digital data (figs. 4 and 6, respectively) varies comparatively 
little with large variations in the mean spatial detail of the random radiance 
field. For variations of the mean spatial detail by nearly 2 orders of magni- 
tude (from 1 /9 to 9 times the equivalent diameter of the PSF) , the information 
density varies by less than a factor of 3. This occurs because the small 
spatial detail associated with high entropies is subject to more degradation 
due to aliasing and blurring than the large spatial detail associated with low 
entropies. 

Information efficiency versus sampling intervals .- Information efficiency 
of discrete data exhibits a distinct single maximum when displayed as a function 
of sampling intervals (figs. 6 and 7) . The location and magnitude of this 
maximum depend on the properties of the radiance field, the PSF and sensitivity 
of the photon-detection mechanism, and the number of encoding levels. Designs 
favorable to maximum information efficiency have the following characteristics: 


^s/°n = 

Sampling interval (X/y = 

Y/Y) for - 

Gaussian 

Diamond 

Circular 

51 2 

0.6 





256 

0.6 to 0.7 

0.6 to 0.7 

— 

1 28 

0.7 

0.7 

0.6 to 0.7 

64 

0.7 to 0.8 

0.7 to 0.8 

0.7 

32 

— 

0.8 

0.7 to 0.8 

16 

— 

— 

0.7 to 0.8 


Sampling intervals narrower than those listed in this table will improve infor- 
mation density if the radiance field consists mostly of spatial detail equal 
to or smaller than the PSF, while broader sampling intervals will generally 
reduce both information density and efficiency. 

PSF versus spatial detail .- For sampling intervals favorable for maximum 
information efficiency, information density and efficiency both tend to be 
maximum when the PSF of the imaging system is approximately equal to the mean 
spatial detail of the radiance field (fig. 6). This result is consistent with 
the earlier discussion about the conditions that lead to the theoretical upper 
limit of information efficiency. These conditions require that the MTF and 
sampling passband be matched to the Wiener spectrum of the scene. 

Kell factor .- Sampling intervals favorable for maximum information effi- 
ciency compare closely with the so-called Kell factor that evolved from early 
studies (refs. 2 and 3) concerned with the selection of a line-scan interval 
(or line pitch) for commercial TV cameras and displays. The Kell factor is a 
measure of the number of lines required to distinguish between black and white 
bars oriented parallel to the line-scan direction. According to Kell et al. 
(ref. 3) , "The average of readings made by several observers indicated that 
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TOO scanning lines were required to make 64 black and white bars distinguish- 
able.” This result led to a Kell factor of 0.64. The concept of Kell factor 
was readily accepted but not its numerical value. Baldwin (ref. 2) lists the 
results of six different investigations/ including his own, with values ranging 
from 0.53 to 0.85 and an average of 0.71 . However/ it should be noted that the 
Kell factor defines the line-scan interval relative to bar targets with widths 
approximately equal to the PSF of the TV camera/ whereas we define 2-D sampling 
intervals relative to the equivalent diameter of the PSF itself and use random 
rather than periodic targets. 

Schade*s recommendation .- Schade (refs. 4/ 5/ and in ref. 7)/ in extensive 
and widely recognized studies of TV systems/ defines line-scan intervals as a 
function of the MTF of the imaging system. His recommendation for a lower and 
upper limit on the line-scan interval/ expressed in our notation/ is 


1 

< 

2Ut=0.05 


1 

X/y s 

2 U '^=0 . 4 


where \j:^_q^q 5 and \jj=0.4 frequencies at which the MTF normal 

to the line-scan direction is 0.05 and 0.4/ respectively. For the photon- 
detection mechanisms considered in this paper/ this recommendation results in 
0.44 < X/y ^ 0.83 for the Gaussian spot intensity/ 0.49 < X/y ^ 0.78 for the 
diamond photosensor aperture/ and 0.44 < X/y < 0.63 for the circular photo- 
sen sor ape r tu re . 

Quanti zation versus electronic noise .- Information density ceases to 
increase significantly with increasing quantization levels when the number of 
quantization levels k exceeds the rms signal-to-noise ratio Cs/On* Infor- 
mation efficiency begins to decrease significantly with increasing quanti- 
zation levels when k exceeds 4as/On* ThuS/ the relationship between 
number of quantization levels and rms signal-to-noise ratio should be such that 
Oq/Ox\ < k < 4os/On* This conclusion/ however/ is strongly dependent on the 
assumption that was made about the (linear) dynamic range of the imaging system 
with respect to the (Gaussian) probability distribution of the magnitude of the 
radiance field. 


CONCLUDING REMARKS 

By tying together the statistical properties of the radiance field and the 
spatial response (PSF or MTF) / sensitivity/ and sampling and quantization inter- 
vals of the imaging system into a single figure of merit/ information theory 
provides an obviously attractive approach for optimizing the performance of 
line-scan imaging systems for a specific application/ especially if this appli- 
cation includes digital data transmission. Although the information content of 
the image that has been reconstructed from the digital data cannot be directly 
measured with practical instrumentation for an objective experimental evalua- 
tion/ the component and system MTF and noise characteristics required to com- 
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pute information content are routinely measured. The Wiener spectrum of scenes 
can also be measured but is often unknown. 

Optimum information density and efficiency require that the MTF and sam- 
pling passband match the Wiener spectrum of the radiance field. Computational 
results for statistical properties of natural radiance fields and the responses 
of common imaging mechanisms indicate that information density and efficiency 
are not strongly sensitive to variations in typical statistical properties of 
the radiance field and that the best performance is approached when the sam- 
pling intervals are about 0.5 to 0.7 times the equivalent diameter of the PSF. 
These results are consistent with the experimental and theoretical results 
obtained by earlier investigators concerned with the performance and design of 
TV cameras. 


Langley Research Center 

National Aeronautics and Space Administration 
Hampton, VA 23665 
July 6, 1 981 



APPENDIX 


FORMULATION FOR PRACTICAL DESIGN TRADEOFF STUDIES 

In this appendix we express the information density h^ formulated by 
equation (10) in terms of parameters that are commonly used in practice and 
provide details about the approximations that were made for equation (26 ) , 
which was used to generate computational results. 

The formulation of equation (1 ) is simplified by separating the spectral 
and spatial dependence of the radiance field and imaging system response# 
with the parameter K accounting for the spectral characteristics. Actually# 
both the radiance field and the system response are wavelength dependent# 
and the spatial convolution should therefore be integrated over wavelength 
(ref. 23) . However# following common practice it is convenient here to let 
K be the steady-state gain of the conversion of the radiance into the photo- 
sensor signal as given by 


K 



T(X) dX 


(Al) 


where D is the lens aperture diameter# y is the equivalent diameter of 
the PSF (or IFOV) formed by the spot intensity or photosensor aperture# L(X) 
and T(X) are the spectral properties of the radiance field and system 
response# respectively# and X is wavelength. 

The Wiener spectrum of the photosensor signal# sampling sidebands# and 
electronic noise given by equations (6) # (7) # and (8) # respectively# can be 
rewritten as 
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APPENDIX 


and 


OO 



The prime denotes a normalized quantity, and and are the variances 

of the radiance field and electronic noise, respectively. If the electronic 
filter MTF Tg(w) sufficiently band-limits the electronic noise, then equa- 
tion (A4a) can be reduced to 




(A4b) 


Substituting equations (A2) , (A3), (A4b) , and (9) into equation (10) 
yields 
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Equation (A5) reduces to equation (26) for c^ = 3, Og " and 


1/2Y 


2 = 










doj 


-1 /2Y 


f 

The (normalized) Wiener spectrum the electronic noise tends to 

either remain constant or to^decrease with frequency, and the MTF of the 
low-pass electronic filter Tg(w) usually remains nearly constant out 
to some frequency near the sampling passband and then decreases rapidly. 
Consequently, < Oj^. 
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SYMBOLS 


A rectangular isoplanatism patch 

|a| area of rectangular patchy 

c constant that relates range of signal fluctuations to range of 

quantization 

g(X/y) spatial function 

g(U,0)) spatial frequency spectrum of g(x,y), 

data density, bits/m^ 
hi information density, binits/m^ 

hi/h^ information efficiency, binits/bit 

hg sampling density, samples/m^ 

quantity of data in A, bits 

Hi quantity of information about A in digital data, binits 

J-|(*) first-order Bessel function 

K steady-state gain of the conversion of radiance into electronic 

signal, A-W“^ 

L(x,y) radiance field, W-m“^ 

m,n sampling counts along x- and y-axes, respectively 

N(y) electronic noise, A 

r2 - 3^2 y2 

r ( • ) reconstructed image , A 

s(*) signal, A 

x,y imaging coordinates, m 

X,Y sampling intervals, m 

Y equivalent diameter of the point-spread function of the photon- 

detection mechanism (i.e., of the Gaussian spot intensity and 
the circular and diamond photosensor aperture) , m 
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•e*> •e* c H > 


<S{x,y) 


two-dimensional unit impulse function, m' 


2 

ri number of binary encoding levels# bits 

K number of quantization levels 

X wavelength# m 

(expected) mean value of spatial widths of radiance field# m 

p2 = + (jj2 

a standard deviation# W-m"*^ 

T(x#y) point-spread function (PSF) or spatial response 

(U#(jo) modulation-transfer function (MTF) or spatial frequency response 

#w spatial frequencies along x- and y-axes# respectively# m“^ 

(cycles-m“*^ ) 

( • ) au tocovar i ance # W^-m~^ 

(•) Wiener (or power density) spectrum# W^-m“^ (W^-m“^/cycles^-m“2) 

II(*) spatial frequency passband of sampling lattice# m“^ (cycles/m^) 

I I I ( * ) sampling function 

* convolution 
frequency domain 

• (prime) normalized quantity 
Subscripts : 

a aliased noise# or sidebands generated by sampling 

b blurring 

e electronic filter 

£ lens 

L radiance field 

n electronic noise at filter output 

N electronic noise at filter input 

p photosensor aperture or spot intensity 
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q quantization 

s analog signal (without noise) 
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